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. I 

PROFESSIONAL DEVELOPMENT FOR 
SELF-EVALUATION: A SELF^USTAimNQ PROCESS? 

Introduction 

This paper provides an evaluation of a professional devetopment training 
program which focused on the development of skills for self-evaluation 
and school devetopment sessions in the context of local, school and ^stem 
accountabtlity. The evaluation sought to esteblish the relevance and value 
of the learning experience, the skill acquisitbn, understanding of the 
self-evaluation process and the feasibility of its tnstitutionalisatfon. 

The rationale which underpins the program is one whteh values and 
respects the need for the collective professional devetopment of teachers, 
school administrators, school district pereonnel and superintendents. Case 
study methodotogy was adopted over a period of nine months, in the 
process of the training program itself, immediately post the program and 
three months later. 

The importance of establishing interdependent relationships to harness the 
collective capacity for responding to new challenges and managing and 
institutiDnalising the self-evaluation process was one important finding 
from the evaluatfon. Three significant factors in the creation of this 
collaborative culture were the role of critk^ue, conferences and 
exhibitions of teaming that partfeipants gained from the self-evaluation 
process and the cross-level development of coltegiality. 

Context 

School restructuring has challenged practittoners and resulted in 
significant changes to the Western Australian education system. The 1987 
report, Better Setiools, recommended the devolution of deciston-making 
from the central bureaucracy to schools. Broader macro controls, in the 
form of school distticts, have replaced the direct, centralised control and 
schools now exercise autonomy over their management in pursuit of 
system-wide objectives. The "self-determining* school is an intended 
outcome of this restructuring process. 

Throughout Australia similar developments have taken place, governments 
are under continuing pressure to Improve and extend services. In Western 
Australia, the underlying purpose of the reforms has been to get better 
value for education expenditure; the belief is that better perfonnance will 
result when schools have the authority and capacity to determine the way 
in which they will achieve the agreed outcomes. 
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This devolution of increased responsft>iHfy to sdiools has necessitated the 
development of nnechanisms and proc^ses for dcimonstrating 
accountability. Schools must demonstrate that they are performing 
effectively In temis of the education the students are receiving and they 
must also demonstrate that they are operating within the policy 
framework of the government system. The school development plan and the 
associated participative dedsion-makliig processes are the main vehicles 
for schools to accomplish thfe in Western Australia. The key elements of 
this accountability process inclucte collective problem-solving by 
school-based personnel in the formation of a statement of school purpose 
and a set of performance indicators. To demonstrate school-level 
accountability the school collects infomnation on student performance, the 
school analyses the student perfonnance data and makes judgments about 
perfonnance of the school and then must make responses to these 
judgments in further planning and participative decision-making 
processes. 

Appropriate professional development to assist with the implementation 
of accountabiluy systems at school, district and central tevels has been 
fundamental, particularly with the recent release of the School 
Accountabniiy Policy and Guidelines which make explicit that: 

" Teachers are expected to implement teaching strategies aimed at 
achieving the speafx: student outcomes derived from the 
performance indicators and to monitor the effec^venss of these 
strategies in terms ofout<mies ... 

A liey aspect of the principal's role as instnjcUonai ieader is to 
monitor and report on the quality of education in the school. ... 

... District Superintendents ... monitor the extent to which a 
school has responded appropriately to /te own perfbnnarwe 
infowfiation ... (fjhis involves an assessment of how comprehensiveiy 
the school has engaged in self-monitoring, how rigorously the 
infonnation has been analysed, ... how successfully plans for 
improvement have been implemented. ' (Ministry of Education 
1991, pp. 6-7) 

The author of this paper is a practitioner responsible for tiie coordination 
and/or provision of appropriate and timely professional development to 
support major stnjctural and policy changes. The research, on which this 
paper is based, was conducted at tiie point of program delivery, participant 
take-up and implementation of self-evaluation in the workplace. For. as 
many have argued, information relevant to educational quality lies at the 
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heart of practice (see, Wasley, 1991 ; Ueberman, DarKng-Hammond & 
Zuckerman, 1991; Simons, 1980; Stake. 1976). 

What follows is therefore a practitioner's insights gained from an 
evaluation of a professional development and training program In school 
seH-evaluatfon which according to partkapants "... empowers schools to 
change ..." and enat)les schools and districts to "...demonstrate their 
accountability ...". 

Background 

The professk)nal devetoprr^nt program fichool Seif-Evaluatton : Monitorino 
and Raviaw was designed, directed and ctelivered by Professor Helen 
Simons, University of Southampton. School self-evaluation, in this context, 
is defined as "... a process of conceiving, collecting and disseminating 
information for the purposes of informing ctedsion making, ascribing value 
to a program and establishing public confidence in the school." (Simons, 
1990) 

To ensure that the training program would be cost effective, it was 
designed with two objectives in mind: to fulfil the immediate training 
needs identified and to provkJe a pool of frainers to train other schools and 
districts. In this way it was envisaged that the evaluation process would 
become embedded in the system as an ongoing part of the operations of 
schools and districts. To facilitate this aspiration the design of the 
training program included teams from different levels of the system: 
primary, secondary, distrtot office and central office. 

With support from central office and commitrront from a country district 
and one other metropolitan district the program was adopted. From each of 
these districts there wero three teams (a primary, a secondary and the 
district office) of three to four people. 

The Program 

Philosophy 

The program was grounded in a theory of school development derived from 
an analysis of pasc attempts to reform schools. The basic premises were 
these: 

that the quality of education can best be improved by 
supporting and strengthening the collective professtonal 
development of teachers, schools and school districts; 

• that this is best achieved through the creation of a collaborative 
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working cuiturs In which tBadiers, schools and school districts 
can safely, critically and puUic^ evaluate their work and the 
conditions in which they work; 

that sdiools and distrids which implennent such a process of 
on-going monitoring and seif-evaluation of their policies and 
programs and open this to public scrutiny, demonstrate their 
accountability to students, parents, the profession and the 
wkier community. 

For a more detailed account of the theory whk^ informs this process of 
school self-«valuation see Simons, 1987. 

Alms 

More specifically the program aimed to: 

• create shared understandings of the context and rationale for 
evaluation and the different roles and responsibilities school, 
school district and centre personnel have in evaluation, monitoring 
and review; 

• give teams of teachers from the same school and teams of district 
personnel the opportunity to collectively plan an evaluation design 
for implementation; 

• offer school staff members, school developnrent consultants, 
principals, deputy principals and superintendents the opportunity 
to learn more about Vire skills involved in evaluation; the 
analysis of information needs, the collection and use of data, 
management of the process and analysis and interpretation of 
results; 

engage participants in analysing and interpreting data collected by 
them as part of the evaluation process and developing critical 
self-reflection of their own and each others' work; 

• share with participants ways of reporting and representing 
evaluation data that is relevant, accessible and useful for 
informing future policy development and action. 

Content 

The six and a half day training course included an introduction t j the theory 
and rationale of school self-evaluation, planning and designing the 
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evaluation, strategtes for ooilecting amj anal^ng data and casa study 
reporting. (For further details relate to tN training program see Simons, 
1990). 

Outcomes 

There were two main outcomes: 

the presentation of a short (ten page) case study evaluation by 
each school and district of a priority issue in their sc^root/district 
development plan; 

the development of a process for collaborative school/district 
self-evaluation and tmining that could be shared and extended to 
other schools and districts. 

Structum 

The program was planned in two parts. An intensive five week course 
(three full days and three half days) followed by two half days and a final 
one day conference to present results. This program was spaced over the 
six months from July to December of 1990. 

Each school and district evaluated a policy issue in depth. The design was 
planned in the intensive course, implemented over the following four 
months and a case study report of results was presented at the final day 
conference towards the end of the school year. Each case study was 
critiqued by a team from a different school or district. An account of the 
self-evaluation process was recorded by each team for sharing purposes. 

Process 

The course was designed Intensively and flexibly to convey a lot of material 
in a short time. No one technique or plan was advocated. Many issues, 
themes, ideas and suggestions were raised to give participants the 
opportunity for choice of strata and technique. It was consklered 
important that schools/districts decide for themselves which strategies 
and approaches would be most appropriate in their particular context. 

The field-based nature of the course necessitated woriiing for the most 
part from participants' issues and data. Each session involved presentation 
of new input, w'rth sufficient time allowed for group work and for analysis 
of specific tasks. Each session concluded with an introduction to the main 
theme of the subsequent week and the task to be developed in relation to it. 
Matoriai relevant to each sessbn was introduced week by week. 
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Fonow Up ana Pm^tatkm of f^utis 

Schools and res^^ctive district personnel shared ar^i exdianged progress on 
their case studies, process accounts and examined the criteria for critique 
on the first follow-up half day In Novemljer. On the second follow-up half 
day, the district office personnel from the three participating districts met 
to make the final an-angements for the presentation day. 

At the final conference day, each district was allocated an hour for the 
presentation of the three case studies. After the presentation of each case 
study the pre-anranged critk:|ue was delivered with the opfX)rtunrty for 
questions and discussion from the entire group. The process accounts were 
discussed and at the conclusion of the conforence superintenctonts and 
senior offteers from central office commented on their participation and 
observations. 

The Evaluatfon 

Purpose 

It was considered ironic for a program focused on evaluation as a means of 
enhancing profossional development to be delivered without conducting an 
evaluation of the program itself. The evaluation was therefore conducted 
to: 

• provide ongoing formative feedback on the intensive training 
program; 

• encourage participants at every stage to engage in a 
self-evaluative mode: 

• provide those outside the program with an understanding of the 
essential leamings acquired by participants and the overall worth 
of the program: and 

• infomi decision-making related to the proviston of subsequent 
programs to sustain the self-evaluation process. 

Methodology 

The issues chosen for evaluatk>n included the relevance of the program for 
participants, the value of the learning experience, the acquisition of skills, 
the understanding of the self-evaluation process and the feasibility of 
Institutionalising the process. These issues emerged from the evaluator's 
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interactions wi^ the course director and parti^)ants (inctuding 
superintendents, district officers, teaciiers and school adnriinlstrators). It 
was in this way that the staltehotcters' dalms. concerns and issues were 
used as organiser of the evaluatton and provkted the evaiuator with an 
understanding of the stai^ehoiders' circumstances, experiences and values 
(Guba and Uncoln. 1989, Stalte, 1975). 

In this evaluation the case study aji^oach was adopted for four Icey reasons. 
Firstly, case study research recognises the Importance of context and 
focuses on the elucidation of values (Geertz, 1973); in this instance, the 
effects of the professional development training program over a nine mont^i 
period in three Western Aus^tralian Education Districts. 

Secondly, descr^)tlve data was needed to more accurately portray the 
complexity of the role of the professional developer (in self-evaluation) in 
a context of accountal)ility; defined in temns of "shared responsibility" 
(Gulm and Lincoln, 1989, p. 257). The evaiuator was also interested in the 
collection of interpretive data to eluddate the significance of the cultural 
context In which the skills of self-evaluation and critique are taken-up in 
tfie professional development program and then Implemented In the 
wori<pIace. 

A third reason for the adoption of case study research was that It enabled 
tiie evaiuator to document the complex interactions between levels 
(central, district and school) and their indivklual circumstances and 
appreciate the complexities of the school or district environment, school or 
distrtet culture and the problems encountered witii the implementation of 
the self-evaluation process. 

Fourtiily, it made possible the fine gralnwJ collection of data about process. 
That is, how decisions are made and why, indivkjuafs perceptions and 
feelings about the decisions. Ratiier ttian focusing on the productton of 
generalisations it is tiie single instance which Is significant (Simons, 
1987, p. 72). In spending time witfi ttie participants and recording their 
learning circumstances, interviewing tfiem and ana^sing tiielr case 
studies, tiieir process accounts and their critiques of one anotiier's reports 
the evaiuator hoped that the data might better reflect tiie actual voices of 
the sample of participants from the School Self-Evaluation : Monitoring an^ 
Review program. 

Qualitative methodology allowed the evaiuator to collect data on tiie 
professronal development program, the stages of skill acquisition, the 
implementation and practk» of the self-evaluation process. It was 
possible with this metfiodology to check tfie evaluator's perceptions with 
the participants so tiiat if the participants had been engaged In the 
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evaluation of the program Itself, tfiey wouW find the evaluation acoirately 
desalptive of their own perceptions or constructlor^ of the program. This 
reflects tte methodology of Fourth General on Evaluation whidi at the case 
report stage "... ... provkJlesJ thick description, glv[Bsl ^carious experience, 

senses] as a metaphoric springboard, and chalteng[es] constructions in 
ways that lead to reconstmctions" ( Guba and Lincoln, 1989. p.193). 

The evaluator attended all workshops awi documented proceedings. The 
written reports from schools and district offices were carefully read, 
collated and analysed. Evaluattons from the coui^ director were also 
ifTCorporated. Throughout tfie continual data gatiiering prcK»ss, attempt to 
minimise bias occurred through cross checks in tiie data collection, 
analysis and reporting procedures. 

To check bias multiple dato sources were used: question and survey forms; 
intenriews (structured and unstroctured); observations of tiie program in 
action, group discussion and interactions', fomnal presentations, case 
studies and critiques. These metiiods were supplements by analysis of 
on-going data input from participant on tiie program, of tiieir evaluation 
designs, fieldnotes of tiie observer and input from the presenter. Tape 
recordings of group interactions and a video of the presentation conference 
were also analysed. 

Reporting was made as accurate as possible through information checking 
for multiple con^boration and by involving inten/iewees in the checking 
and proofreading processes. Misinterpretation as a possible source of emor 
was minimised by seeking confinnation from participant tiiat tiie case 
study report was fair and authentic. In many instances the evaluator 
included direct quotations from tiie inten/iews, from transcribed tapes, 
from fieldnotes and from the video ratiier tiian reporting interpretively. 

The data collected via these means was organised into major themes, 
categories and case examples through content analysis, in tiie analysis of 
data, triangulation occurred and tiie dominant tiiemes which emerged are 
tiie result of triangulated data. 

A range of program participants from central office, district office and 
school were represented in tiie sample. They were selected because tiiey 
represent the different levels witiiin tiie Ministry of Education and 
tiierefore hoki attferent kinds of roles in tiie accountebility process. K was 
necessary to illustrate the complexity of tiie actual roles within their 
context and the complexity of tiie role relationships. The evaluator 
wanted to illustrate to others the nature of these roles and role 
relationships in this professional development context The data was also 
analysed for clarification of tiie issues which guided tiie evaluation. 
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The data analysis process involved ^veral readings of alt datei for general 
familiarity, the assentoling of Information In categories such as: the 
training program; the case study reports; the critques; the process accounts 
and aii^ncation beyond the timeframe of this program. The final stage in 
the data analysis process was the identification of themes and process 
issues. 

Emergent Themes and Prorass Issues 

To harness the collective capacity for responding to new challenges brought 
about by restruc^jring it was important to create a collaborative culture 
and develop interdependent relations through building tnjst and respect for 
colleagues across levels. The enwrgent themes and process issues have 
been organised to illustrate how this was achieved In a professional 
development context. 

1. Establishing A CoHabomtiveCulbtre 

(a) Developing a Supportive Environment 

From the outset the presenter yms av»«rB of the need for a supportive, 
affirming environment which was comfortable, free from outside 
intenxjptions and conducive to interaction. She reported in her written 
perceptions of day one that four teachers had commented "that this was the 
first time that they had been to a course in such pleasant sunoundings 
(usually, such meetings for them take place in nonnal offices or school 
buildings) and this was also the first time mat they had attended a course 
with school principals and district office personnel." 

Attention to support is again reflects in the presenter's written 
perceptions; she indicataJ that she would have preferred more time at the 
outset devoted to getting to know participants and tiieir concerns but this 
conflicted with the need to move quickly into the substantive part of the 
program. It was also inhibited by the attempt to get an eariy written 
understanding of partiticpants' expectations of the course. 

In the establishment of interdependent relations Professor Simons was 
particularly sensitive to the need to listen to participants' feelings 
concerning their involvement in this program, their fears, anxieties, their 
enthusiasm at being involved in a workshop with their peers and their 
superordinates, in pleasant surroundings witii attention to decor, catering 
and comfort 

The process of establishing this professional culture then took place 
directiy through tiie context and sti-uclure of the program and indlrectfy 



April 5, 1992 



^1 9 



through th© social relationships created throughout Every opportunity was 
taken by the presenter (Including, morning tea or lunch breaks, fbltow-up 
sessions, continued written and teped communication) to find out more 
about the participants, their expertise, their spedfic development needs 
and ttieir expectetions, and to provide them with feedback and continued 
support 

Follow-up interactions with partlapante that focused on their problems 
and concerns about self-evaluation were built into the program and the 
accurate prediction of critical inddente in the training program which 
required further appropriate supf»rt assisted in the successful take-up of 
the training. However, despite her attention to this requirement the course 
director dearly wouW have liked more time as was indicated in her final 
setf-evatuation which was distributed to participants: 

7 would have Uked to haw visited each of you on site, though 
that is very expensive in time of course. In trying to be 
rest>onsive to the reqmrerrwrrts/needs of each groi^) and 
individual, it was difficult at times to feel that one had metsU 
individual needs, as intSyndMs and groups were at different 
stages in their experierwe and requirements. ' 

(b) Establishing a Resourceful Learning Environment 

Participant commente indicate that a most useful aspect of the p^ram 
was the sharing which took place between groups: 



"... the feedba(^ from other people regarding our process 
of evaluation and tasks we are undertaking" 

"... discussions in groups following me input given" 

further discussion that was generated by the 
feedback from groups." 



An analysis of a tepe recording of the group interactions and discussions 
underpinned this point revealing the importance of interchange for 
reinfordng learning and for clarifying the thinking of the groups. 
There were three particular features of this: 

(i) The Importance of Focusing and Asking the Right Question 

It was through engaging in the process of progressive refocusing that 
particlpante became aware of the crucial need to ask the right question. 
This was illustrated when in the process of sharing, and discussion of one 
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group's ^tectsd issue for evaiuation, it became dear to tliis metropolian 
district that aslcing the right question for evaluation purposes was 
fundamentat. 

"OnB of the issues [which emerged] ... tvas i¥he^ the 
ques^on we were eslortg is at^fy the most important 
question in tNs area [of fmifessional c/e\mk)pment for 
prindpals] and [^J we see ptl rm, probably iK)t me most 
important. The most important & the effectiveness of ... the 
professional development prf^ram, we've chosen not to 
evaluate that part of the program i^elfbut to evaluate 
[whether the needs of the prindpals are being met] by the 
program." 

(District Officer from {Metropolitan District) 

".../ can understand whyy^u said, lefs establish needs ftrst 
and make sure mare meeting [or].. »ying to meet [the 
prin(^ls'] needs, then we can question how effective we've 
developed [me program], othenme you've got two factors in 
which you get lost ... It seems to me yi^at you've got in mis is 
a basis for ending planning for prof^sional devek^ment for 
a cSstrict and a process whk^ can be repeated reasonably 
simply, year after year. ... I mink you've resohred,.. how you 
can generate professhnal devetoprrwnt in a maintenance way. 
Not have to sit down from scr^di every year ... " 
(Superintendent from the other Metropolitan District) 

For another district it was through this process of critique and sharing that 
it was made clear that the issue they had chosen for evaluation was too 
broad and needed to be focused more precisely before it could be evaluated. 

(ii) Identification of Bias 

A second feature of the importance of the sharing process was the 
identification of bias as this district officer Indicated in reflecting on 
taped interviews with school staff: 

" ... as the person delivering the questionnaire, I was able to 
listen to the tapes and mink more about me process, and 
looked at my bias, and the barrow [I] was pushing, I Just 
changed me way I was going about me whole [issue], " 

In this instance the district officer listened to other "stalcehoider 
concems" related to the issue chosen for evaluation; the extent to which 
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the district office purpose statement and programs reflect client 
expectations. The particular "construction" (Guba and Uncoln.l 989) that 
the district officers had fdrmuteted reflect district office 
drcumstences, experiences and vaiu^. By approaching stalteholders at the 
school level the distiict officer was forc^ to confront and deal with the 
'constructions' of other groui:^. In this particular instance, as Guba and 
Lincoln have suggested, 'the effect of the confrontation ... produces rapid 
change In the constructions of virtually all groups, and, if it does not lead 
to consensus, it at the very least exposes the several positions with 
electric clarity." (1989. p. 55) it was in this process of achieving greater 
appreciation of others' constructions that a great deal of learning took 
place. This was particularly significant in the case of the district office 
given the context of restructuring. 

(Hi) Analysis of Results 

A third feature of the importance of the sharing process was demonstrated 
on the follow-up day in November by ttie interest, enthusiasm, and 
commitment of the group and their comments on the extent to which the 
process, within their schools and districts, had been implemented. A 
significant part of this was how the analysts of results, in particular, had 
proved to be thought-provoking and stimulated further inquiry. For 
example, the secondary high school team in one of the metropolitan 
districts indicated that the student source of data had been most 
illuminating and referred to the impact of a strategy employed to identify 
students who were consistently absent from school. This strategy was 
immediately recognised by the primary school as tMing one which they, too, 
cou\6 adopt for the possible achievement of similar results. 

This level of sharing - data, results, action - was emerging as an important 
factor in the establishment of a collaborative culture. 

(c) Team Work 

In designing the program Professor Simons emphasised the importance of 
team woric in prcKiucing a good quality monitoring, review and evaluation 
system. Hence there were teams of teachers fram the same school and 
teams of education officers from the same districts woridng together; and 
in the conduct of the workshops attention was given to sharing the process 
and critique with other schools, with other districts and between levels 
(primary, secondary, district office). 

Opportunities to network, to share concerns and findings, to take advantage 
of the rich learning environment were built into the program design. 
Appreciative comments pertaining to these opportunities Illustrate the 



April 5. 1992 



14 12 



value and signiflcanca for r^rtid(>ants. For instance, a district officer 
commented that for tiim the most rewarding aspects of the program were 
"[e]xposure to critical feec&ack ttmt didn't hurt ... and ... of the coitective 
wisdom available in this tfpe of workshop." 

Z Culture for Critique 

A critical part of the philosophy of the training program was the exposure 
of the group to critique and the establishment of an appropriate culture for 
honest evaluation. This was achieved through the expertise of the course 
director, the design of the program, the commitment of the participants, 
and the establishment of a supportive, afflmiing culture in the conduct of 
the course; nurtured and maintained by respect for the following values, 
norms and attitudes. 

a) Clarifying Expectations / 

From the outset, the exf^ctation that participants would be required to 
critique each other's worii was made explicit, it was an assumption on 
which the program was based. 

" ... an important element in Uie development of a 
self-accounting profession is constnjctive critique of eac^ 
otfier's work ... ttie emphasis in tire des^n of the program to 
critique eadr other's evalua^n plans, methods and procedures 
to be adopted and tiie final case study analysis and report. " 
(Simons, 1990) 

Although Professor Simons returned to London after the intensive pan of 
the program she maintained communication links witii all participants. By 
attending to indivklual concerns and anxieties, the interdependent nature of 
the relationships established was maintained. In response to specific 
concerns related to expectations the course director had several points she 
wished to emphasise to facilitate the completion of the case studies. 
These comments were faxed for the fbllow-up meeting. Prominent amongst 
tiiem was a concern tiiat participants may be collecting too much data, 
analysing too little, and not relating the data closely enough to the focus of 
the study. 

The emphasis was on the need to keep the study t)otii relevant and 
manageable". 

The evaluation study is note full-scale research exer&se 
requiring all tiie cross-referendng and detail required for 
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resean^. Keep thB purpose in miml - to raise and anatyse 
issues to inform d&^sionHrmtdng and development' 

Participants were reminded of the crucial to nialce meaning out of the 
data by focusing on the emergent issues, themes, questions and resultant 
learnings. The point was also made that for the critiques to be 
constructive participants should not refrain from raising critical issues: 

" ... remind participants ... nottot)etoo polite and too 
commendatory ... the point of the exen^se is to encourage fair, 
tjaianced and obiective reporting and for this some 
(X)nstnjctively aitical comments are often newssar/' . 

b) Participant Generation and Adoption of Criteria for Critique 

On the fifth day of the program, the participants generated the criteria by 
which they wished their evaluations to be critiqued (see appendix I). By 
involving participants in the generation of the criteria for critique, 
ownership was assured. This process of participant involvement also 
enabled individuals to, singularly and collectively, demonstrate some of 
their knowledge and understandings gained from the professional 
developnnent program. 

The criteria for critique were rephrased as questions and reordered to 
form a sequence. Professor Simons in her written communication to 
participants, in September of 1990, stressed that these criteria were 
guidelines to help in the presentation of critiques and that not all would 
necessarily be relevant to all studies, In fact other implicit criteria could 
be more appropriate and tiierefore should not be ignored where relevant to 
a fair critique of the case. 

c) Constructive, Supportive, Participative Environment 

The need for participants to be constructively critical in tiieir critiques, 
that is, not to be too polite and too commendatory was emphasised. The 
Director of Studies, drew on her understanding of groups and group process 
to remind participants: 

" There is a tendency with groups who have been working well 
together for them not to want to t)e 'criticar of each other's 
work. This of course is quite understandable. However, the 
point of the exercise is to encourage fain balanced and 
objective reporting and for this some constructively critkiai 
comments are often necessary, " 
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One way to achieve an environment which was oondudve to constructive 
critique was to involve participation at ail levels. This was evident to the 
presenter when upon reflection of teachers' comments related to the 
significance of attending a course with school principals and district 
office personnel she noted: 

7 would like to buUd on this in safiiseQz/enf sessions and 
encourage more mixing of levels. This seems to me very 
inyjortant indeed in estat)lishing confidence in the process of 
change in the system. " 

Participation was consequently built into the program at all stages, in the 
process of the course through structured inter-level group critique, in the 
team wori^ expected in the case studies and the expectation for 
presentation. 

d) Feedtmck to Partidpants 

Throughout the program the Director of Studies provided feedbad^ to 
participants concerning the application of their leaming and the progress 
made with evaluation studies. In providing this feedback the presenter 
demonstrated tho need to be constructively oit'cai and was engaging in 
double processing by exhibiting how to critk|ue. 

Important learning, guk:lance and support resulted from the presenter's 
exhibitions of critique. To illustrate, after day three, partidpants had 
received input on how to plan and design tiie evaluation, strategies for 
collecting and analysing data, and had been set tasks which required them 
to collect data using observation, interview and questionnaires. On day 
four, in groups, they were required to share tiie data collected. The 
Director of Studies, drculated from group to group, listened to tiie 
interchanges and provided feedback to tiie teams witiiin tiiese groups. 

In a plenary session which followed Professor Simons made constii^ctive 
critical comments such as these: 

There is a tendency to confirm hunches ... *what we thought 
already' ... may need to think about another interview schedule .. 
need to keep it open. " 

There is a lot of seeking conHnnatbn rather than seeking 
divergence ... may like to seek a contrary opinton ... try to get 
people to think more divergently." 
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Tenden^ in some intefvlews not to p/ote enough ... need to ask 
can you give me a little more infonnation, ' 

This feedback was helpful to participants and agisted both in deepening 
skilis and in promoting an environment which valued critical feedback. 

Findings 

The findings have been organised into themes and issues and are dealt with 
in three sections; the finst deals with issues related to the course, the 
second deals with issues emergent from an analysis of the process 
accounts and the third section deals with findings concerned with the 
Implementation of the self-evaluation process beyond the timeframe of 
this program. 

1. Findings Related to the Course 

a) Utility of the Course in an Accountabitity Context 

In offering perspectives about the utility of the course for others the 
following comment captures the major themes: 

"AH Government schools would benefn from this prfHsess 
' in fact it's necessary if school self-evaluatior^accountability 
at self-determining school level is ... the requirement.'' 

In Western Australia the school-based management concept is derived from 
public sector management refomn which is focused on efficiency and better 
use of existing resources. The language used to describe the restructuring 
and decentralisation which has taken place in this education system has a 
corporate managerial tone (audit, (imrformance appraisal, corporate plan, 
performance Indkators). Getting the educational interpretation of 
management language and discovering that it is not new was a key factor 
for commending the utility of this program. 

The [reason for recommendationj is the actual way Helen 
structured the whole program linking it to change and managing 
change, ... very valuable, very empowering," 

This superintendent made the point that empowering teachers and schools 
to feel free to go ahead was a major priority of this project and one that 
the program "does well". 



April 1992 



18 

16 



b) IMHyofHw Design andStrucft/m of the Course 

In reflecting on the structure and presentation of the program a participant 
superintendent had tills to say: 

"... of course Professor Sinwns has done what again, verygrnxS 
inseryfwe work does, got a prhdpal and a couple of sl^nifiGant 
and key teachers and thafs the way in whk^ you ac^alty 
emf)owersomes(^^todmngeitmirtiehavhur,mn*tit? IVs 
Just excellent professional devetopment... the cwitentb reafiy 
apprt^ate and ^ in perfectfywith vi/hatwe need. Heractuaf 
presentatkm and Um context in v^k>h she presents [material], I 
believe, is &iUcsd and iVs a very wen planned fmfessional 
devetopment activity, whk^ maximises the change of people's 
behaviour, the tea<^ers* Iwhaviour, the s(^K)ors behaviour - 
changing^ that they can do thek'jca> better. Nott^angingso 
they can do something that someone else wants them to do. " 

c) Utility of the Prot^ss Across Levels and WitNn Ministry Plans 

One of the superintendents had been involved in a project focused on 
accountability as it applies to schools in Western Australia and the link 
with tills program was evident for him. In his words: 

The key to the link is simpfy through what question you ask. 
Whats this evaluation about? And then, what questions should 
be asked? In relatton to whetiiera school was achieving its 
purpose the questions to be asked would in effect be the 
performance indicators." 

In this way he was illustrating ihe relevance of this evaluation process to 
school development planning. He demonstrated tiie broad application of this 
process to other levels of tiie school by refening to how teachers could use 
tills evaluation process in their own classrooms and how schools could use 
it to evaluate school programs and support processes. 

'you can still use the same evaluatton model to evaluate any 
aspect of your school. * 

To f urttier illustrate tiie utility of the course and the relevance of the 
process across levels, tiiis superintendent Indicated that the design of tiie 
course had enabled him to demonstrate how he could fulfil his auditing role 
in a non-threatening ^y. 
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"Ifs great forme to attend a wori^tiop ofttils nature wth some 
sdwol people and some (Sstrict office peqiide, 0ven that it 
really ^ the nf^ ttirtHigfi wNch my wori( is gokig to go, Ithink 
that those school attendir^, &in rmny see how lean do my 
aiKiit job in a non-threatening way and this fits in exactly with 
how I see myself in my atKlit rote. What I'm reaify going to be 
auditing is the process, the scfKTo/ developntent process. A 
significant part of which is re&Ify s^f-evahjation, so it fits in 
exactly. Thafs my experience. I'm sure you knew that when you 
were organising the workshops ... it was no accident ' 

d) Skill Devetopment 

One of the superintendents, who stated unequh/ocal^ that he would 
recommend such a course to other colleagues, highlighted the upsktliing 
nature of the program, as the key reason. 

'It is pmviding the skills necessary to do a seV-evaluatmn at 
any level and if I think about the level thaVs ofpartiajlar 
interest to me, ^aVs the sdTOO/ ctevelopment plan level. ... 
Schools have tieen managir^ their informatmn systems. Some 
good schcx>l$ have been doing it very v\mll. ... Schools have also 
been acanjntable for their work What they havant done is 
demonstrate their accountability. ... [this program] is a beautiful 
exampis of bringing the two together. " 

Many participants attributed their level of skill development and 
competencies attained to the design of the course, the high quality of the 
presenter and the opportunity and challenge of working with a range of 
staff who are not readily available at the school. 

e) Across Section Applicability 

The utility of this course for other sections in ttie central office, such as 
the curriculum function, was recognised, it was suggested, for instance, 
that in determining student outcome statements the cuniculum directorate 
could benefit from lessons learnt regarding the need to identify criteria and 
the need to accept that tiiere exists a reasonable number of things to 
evaluate sensibly at a particular level. 

'We've got to make sure that the criteria remains in control of 
schools and teachers. .... at the level of a school management 
information system ... you've got to really control the depth to 
which you go into any thing and the number of criteria you use. 
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Ottwrwise it b^mes unmanageat^. I tNi^ Helen mmSe that 
point ... If you the massive oTiacsk^ itdoesnt work, ... / 
think Umt psj to me Just the single t^ of the m^sage that 
central offhe peop^ are advised to heed. " 

f) In Depth Questioning 

A participant from a metropolitan district, emphasisecl the valuable 
opportunity provided for teachefs to examine an educational question in 
depth. 

"... day to day tasks tend to take over from the real educational 
questmns that teat^ms would Bke to invest^te fur^r, Uiis 
course provkies people with a wonderhtl of^rtunrty for their 
own professional dev^ofment and a/so improve their morale 
and 0ves them the capacity to actually stand ttack from their 
work and evaluate it. " 

g) Academh StrengUi 

The academic nature of the course was recognised as a strength. 

"... it is stret<^ing our thinking, whic^ is quite different from a 
tot of the other programs that have been run by the Ministry." 

Further comments indicating the learning for this individual included: 

"Professor Simons ^ givir^ us the processes and skills ... so 
that we can do our own evaluation, without having them 
imposed on us by someone else, " 

7 feel that everyone does what's expected of them, and has 
really tried ... examining carefully , ... People do feel privileged 
to be involved ... and thafs (^finitely how it's t)een presented 
to us. We are lucky to t^ involved in it, this is a wonderful 
opportunity to learn about self-evaluation. " 

h) Value of Critique 

Participants discovered that conducting the crit'que of each others* work 
proved to be a powerful learning experience. 

* 2^79 critiquing process over the last three months has 
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enabied us to tighten up in oor awn s^wois ttie seif-evaluation 
process." 

'Doing the aitique is part of the teaming of actuaHy doing a 
setf-evaluaUon," 

Several teams heeded Professor Simon's instruction to "be constructively 
critical in their ciitk^ues". To honestly confront other teams with 
constructively critical comments was not an easy task. In the actual 
delivery of these critiques speakers ctemonstratad signs of tension and 
uneasiness. However, for tiiese teams that rigorously took up the challenge 
of tills critical confrontation tfie outcomes were beneficial. 

The point has t)een made re the usefulness of critiquing as a 
process of ieammg the sldl^ for yourset)ms. We found ^i$ very 
helpMin our project as weilandlilte has already tmen said 
when we were Miquing your study it gave us a lot of ins^ht 
into what we had done and ways that we should have done it 
perhaps differently 

After participating in a modified version of this course in 1 991 a deputy 
principal had this to say: 

'/ can see the value in doing the critique t)ecause it malies you 
reassess your own evaluatbn a little rnore otjectively and it 
gives a different viewpoint when you receive feedbm^ from 
other people and of course the quesUon of accountability is also 
addressed." 

2. Findings Related To The Process Accounts 

The second intended main outcome of tiie fining program was for each 
team to produce an account of tiie process on undertaking school 
self-evaluation for the purpose of analysing the utility of the process for 
participants themselves and for otiter schools and districts beyond tiiis 
program. The criteria (see appendix II) to guide tiie production of tiie 
process accounts were generated by participants in tiie workshop program. 

a) Collegiaiity 

In terms of the utility of the process a germane conclusive statement was 
that "tiie self-evaluation process was ^ catalyst for action". It was 
reported that the process also engendered a "spirit of collegiaiity" through 
the sharing of ideas among staff members and with parents and by learning 
from one another. 
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The outcomes were evident for part^pants involvecl in the process v;hlch 
they felt tmd provided ttiem with valuable reflective tinte. it v^s possible 
to malce comparisons across schools and to appredats ffKllvidual 
differences. Focus on similarities he4>ed the parti^mnts learn. One 
primary school indicated that the proc»ss had "provided direction and 
established that what we seem to be doing is on track" the process also 
indicated the need for change: "we will make some adjustments and changes 
for next year". 

b) Taking Controt 

Participants felt that they were 'pioneers' and that Involvement in this 
process was enhancing the professionalism of teachers; "we are learning to 
believe in ourselves". This conclusion vras reached becau^ from a primary 
prindpaPs point of view "as professionals we have had the opportunity to 
demonstrate that we are in control and that we are accounting for our 
performance." He added that "we are developing community avirareness of 
the particular priority area [chosen for evaluation]'. Another teacher in 
commenting on the value of the process, in giving direction, described the 
good feelings associated with knowing t^iat "we're going O.K. and that we're 
putting plans into action." Taking control of strategic planning has been an 
important outcome for these participants. 

c) Quality of Education 

In relation to the quality of education, the process had been professionally 
developing and had encouraged participants to think phitosophically. The 
infonnation and discussion bases had been enlarged through the involvement 
of students, parents and the community. These participants felt that the 
qualify of education had been enhanced by the shared risk taking, the 
critiquing of each other's self-evaluation project, the resource sharing and 
the wklening of the resource base, through the establishmsnt of a pool of 
trainers to train other schools and districts. One principal refered to the 
professional manner in which teachers involved in this process were able to 
artksulate the school planning process and demonstrate how the 
self-evaluation linked to purpose statements and the priorities of the 
school. 

When repeating the process this group highlighted the need to "set realistic 
parameters, be aware of tiie time constraints and distractions, support 
teachers in their change efforts and acknowledge that school improvement 
has to be across the whole school." 
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d) Cost Effect 



While the structure of this program ctosign was recognised as expensive 
(six and a half days training plus the time to conduct the self-evaluation) 
participants nevertheless ttiought it was valuable as a model for future 
professional development programs. 

"As tsar as insen^ng ^Tes ^is is the way to go, too often we 
gotoalectureandUiat'sit;we^ngotm(^towork. The 
implication is that there should 6e more inservice in this way, " 

e) Production of Guidelines 

In evaluating its own process of conducting a case stu<fy evaluation, one 
secondary high school product a guide to school self-evaluation, which 
outlined eight stages: from selecting the issue through to presenting the 
report. 

In the description of each stage, key characteristics and the essentol 
consklerations were included. For instance in stage one. select an isstfo, 
the need to relate the issue to the school plan, involve the whole 
staff^school community and work collaboratively represent the essential 
evaluation needs. These considerations are elaborated upon in the process 
guide: 

"In most cases the issue will arise from a priority in the 
school plan. The issue needs to t)e one sufH>orted l>y the staff as 
an area which needs to be looked at and assessmi. The Staff need 
to work as a team and suppo^ the process of evaluation. " 

This guide emphasises the need to plan to plan. It was a most welcomed 
unintended outcome of the process and one which is significant in 
establishing the self-sustaining nature of this program. 

f) Prioritising 

All groups chose to evaluate issues from their sdiool or district 
development plans. It was evident from participant discussions that the 
issue chosen needed to be regarded by staff and community as pertinent to 
school development 

It was also stress^ that the focus of the issue needed to be clear from the 
outset and the temptation to huny into the data collection phase without 
dearly identifying the issue was to be avoided. 
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g) Time 



One major con(»m was how to find time. Th^ was taken up by an 
administrator from a metropolitan secondary sdml who stated that the 
course had adequately met the needs of the school " however one concern 
remains and that is the Hme' factor.' 

it was difficuit of course to stop participants taldng more time than 
necessary. Throughout the program it had been stressed that "if evaluation 
Is to facilitate school development and become part of an on-going 
monitoring exercise, it needs to be «x)nomlcai. that is, within the time 
scales in which teachers and admlntetrators worlc.* it was also emphasised 
that the evaluation proc^ needs to be conducted ' ... witiiin the 
competence of tiie staff and needs to be meaningful and accessible to otiier 
staff and audiences to whom tiie results are disseminated." 

From observations of teams and from the analysis of tiieir process accounts 
and presentations at tiie conference it was apparent that tiielr motivation 
had accelerated the time taken and In some cases it was reported that: 

"Tempers took up the t^lfenge ... each teacher has token up the 
challenge to do more tor themselves and tor ffreir students ... 
they have eagerly taken on more work. " 

The secondary high school group Indicated tfiat the amount of time spent on 
ttie process was excessive; "... we had not planned on Jthls amount of time] 
when we started", "... not saying tiiat it wasnt wortiiwhile ... was very 
valuable but if we're looking at tiiis witii a view of insen^idng or working 
with otiiers in future tiien tills real^ needs to be pointed out" It had been 
an important leaming expertonce to discover that it was possble for "some 
tilings to be gleaned ... don't have to go into so much deptii given the 
experience of tiie process." In otiier words through tfie process itself 
individuals had developed tiie confidence to ascertain tiie nature of the 
exercise and to dec^e on tiie appropriate deptii for tiie evaluation. Anotiier 
occasion it could well take less time. 

In the guidelines for school self-evaluation, produced by the metropolitan 
secondary high school, this important time-related issue was included: 

To undertake a self-evaluatbn process Is time consuming; 
there will have to be trade offs between the depth to whtoh an 
issue is investigated, versus the amount of time available to 
undertake the evaluation." 
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A second time related factor was the timeframe and timeline. All groups 
agreed that it Is more realistic to conduct this type of evaluation when 
there are not quite so many time demands on teadiers and adminstrators. 
Term two and/or three are preferable to temn four for such a project The 
Importance of planning to plan was highlighted. 

$. Findings Related to Implementation Beyond Uw Program 

In 1991 only one of the metropolitan education districts harnessed the pool 
of trainers within their district to provide professional development in 
school self-evaluation to others. In this district, teams from eleven 
schools attended a modified version of the program School Setf-Evaluatjon: 
Monitoring and Review. Delivery of the nuxiified program was conducted by 
the district staff who he^i completed the program in 1990. Th#y also called 
upon the expertise and knowledge of the other two teams of staff (primary 
and secondaiy) to assist in the presentation qf sessions and the 
implementation of the process. The District Superintendent was committed 
to the project and provided the support, some financial as well as 
interpersonal, to enable the take-up of the program by otiiers within the 
district 

In the country district in 1991 a change in staff at the district office level, 
including the arrival of a new Superintendent, meant ttiat the support and 
commitment for the school self-evaluation program was tost. Similarly, in 
the other metropolitan district, the transfer of several key people who had 
completed the training in 1990 impacted adversely on the impetus to 
provkJe training for others. The Superintendent from this district 
acknowledged the need for a maintenance program in 1991 and was 
disappointed at the lost opportunit'es. 

The evaiuator conducted discussions, visits and/or interviews in 1991 with 
all participants of the 1 990 program With the exception of participants 
from the country district, all had conducted a further evaluation in 1 991 . 
In implementing the school self-evaluation process they found they were 
sharing their knowledge, skills and understandings wrth others in their 
school or district. 

At the central office level a Professtonal Development and Training Unit 
was established in 1991 and it was possible for a modified version of the 
seif-evaluation course to be offered and completed by teams of 
participants from a further two secondary high schools, a metropoHtan 
district office and five primary schools. 
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Conclusion 



Currently the teaching profession is under tremendous community pressure 
to demonstrate performance and to be accountable for student outcomes. 
The School Seif-Evaluation : Monitoring and Review trainir^ program, 
derived from a concept of school self-evaluation and critique for school 
improvement and development, has provided partk:ipants with a useful 
process and appropriate skills to expltcitiy demonstrate the 
self-accounting professional nature of the education system. 

Clear indicators of the successful nature of this training program ars 
firstly, the completion of an evaluation of a school development priority 
issue and presen^tion of a case study report for critKiue by the nine teams 
involved in the entire initial program. Issues diosen were identified as 
school or district development planning priorities and ranged from policy, 
to classroom management and curriculum issues. 

Secondly, these teams, in their case study reports, identified Implications 
for action which involved initiating changes at the classroom, school or 
district levels. In most instances, these changes built on existing policies 
or procedures, and required improved support and communteation links with 
colleagues, staff, student or community members. The scope for growth 
through self-evaluation was recognised: "the catalyst for action". 

Thirdly, the cross level teams which were established proved to be 
valuable support mechanisms for consolktating and sustaining the learning 
of both content and process beyond the timeframe of this program. In some 
instances, the process for conducting self-evaluation and school 
devetopment review has been implemented and is becoming institutionalis- 
ed, at school and district levels. 

Impetus for Action 

Seif-evaiuatK)n as a process for improvement continuous and ongoing, 
and is characteristic of change implementation based on a model of growth 
(Simons, 1987). The participants of this program have a process for school 
self-evaluation which in some instances has become self-sustaining. It Is 
through the identification of tmplicat'ons for action that change at the 
school or district levels has occurred and has enabled the self-evaluation 
process to sustain itself. For participants this process has been 
energising, rewarding and empowering: "evaluating what we have cho^n not 
what we have been tokj to evaluate". 

The devebpment of a process for collaborative school/district self- 
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evaluation and training that can be shared and extended to other schoois and 
districts was another intended outcome of this program. This sharing and 
extension was accomplished in 1991 when nKXlified ver^ons of this 
program were offered to colleagues t)y participants and to sc^ol teams by 
one of the metropolitan Districts and by the Professional Development and 
Training Unit of the Central Ministry. To ^me extant the evaluation 
process is, in this way. becoming embedded in the system as an ongoing 
part of the operations of schools and districts as mora teams from the 
different levels take on this training from the available pool of trainers. 

Issues requiring attention in such ^lining sessions can be drawn from this 
evaluation and form the "frame and impetus for action" (Guba and 
yncoin,1989}. 

The collecthre professional development of teachers, administrators, 
superintendents in the school self-evaluation proce^ proved to be a 
powerful strategy for improving the quali^ of education. It is one way of 
establishing a collaborative culture, one where all levels can demonstrate 
their accountability in an environment which is supportive and 
non-threatening. 

The design of the training program provided for spaced, experiential 
learning and maximum participation by all team members, at all 
levels, in tasks varying fbmi the development of criteria for critique, the 
selection of a priority issue for evaluation through to the delivery of the 
final case study report 

Many opportunities to networic, to share findings, to be exposed to 
critical feedback, to tap into existing expertise and resources vmre valued 
in the process of acquiring skills and demonstrating achievement The 
reflective time available, the interacttons with other schools and distncts, 
the opportunity to rigorously debate and ask critical questions resulted In 
genuine communication. 

Critiquing each other's work proved to be a rch and rewarding learning 
experience which enabled participants to integrate their learning and to 
further demonstrate their understanding of the concepts and content of the 
school self-evalutation process. 

A skilled facilitator and content expert was respected and valued, for 
her attention to the devetopment of a supportive environment, 
establishment of interdependent relations with partidpants. provision of a 
rich and academically rigorous learning environment and challenge to 
indh/iduals through course design and content Many participants felt 
privileged, motivated and committed as a result of the presenter's empathy 
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and attention to developing relations of tost. 

FeasttMfty, manas^Ulity and utility are c^ria to be oi>servad in 
the planning and Innplenientation of the scIkk)! self-evaluation process. 
Many participants indicated the time consuming nature of this process. 
However, as was made dear by the Director of Studies teams need to be 
time efficient and, if necessary, creatively find time or refocus to keep the 
evaluation manageable. The production of guidelines for conducting a school 
self-evaluation by one of the ^ihool teams will assist others in thte 
process and underlines the need to plan. The produc^n of these guidelines 
has also contributed to the self-sustaining nature of this program. 

Finally as discovered by partldpants of this program and summed up in 
these guideUr ^s 'Self-evaluation is a fM^liticai as well as a 
techniral acthrity. Besides ... understanding the technical nature of the 
steps in a process, evaluatoi^ should be well aware of political 
considerations which may hinder or help the proc^. Staff involvement 
should be widely sought, to give 'ownership" to any project .. staff input 
should be recognised on an individual or group level. Cooperation In 
evaluation exercises should be encouraged by appropriate strategies rather 
than demanded as a matter of course." 

Training and development which values and respects tiie need for colf^ve 
professional devebpment, establishes a collaborative culture through 
cross-level development of interdependent collegiai relations, values 
critique and demonstrations of teaming in the adoption of self-evaluation 
processes has provided tiie impetus for action for an increasing number of 
practitioners in the Western Australian education context. "Professional 
growtii for quality education" is an intended outcome of tire self-evaluation 
process and one which has tiie capacity to be self-sustaining gh/en ttie right 
level of commrtment, support and collaborative action. 
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Appendix I 

CRITERIA FOR CRITIQUE OF SCHOOL/DISTRICT SELF-EVALUATION 

The questions to be addressed in the critique of a partidpant group's 
evaluation included: 

• Is there a clear statement of the focus and purpose of the study? 
Is the issue chosen related to school/district development plans 
and/or Ministry priorities? 

• Are the key questlon/s appropriately link^ to the issue chosen for 
evaluatbn? 

• Is there a clear statement of the context for, and constraints upon, 
the evaluatbn? 

• Are the methods chosen appropriate to inform the questions being 
asked? 

Had adequate attention been given to ethical consideratio:.s? 

• How has the team aspired to meet impartiality In the conduct and 
presentation of the study? 

Is the data valid for the purpose of the study? 

• Are the implications for action adequately drawn from the data? 

• Has the original question/s been answered? 

• Is the study accessible and communicable for the audience/s it 
aspires to reach? 

• Has the study been feasible and useful to participants, the school 
and other audiences? 

• Has the study been conducted and presented imaginatively and 
creatively? 
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ERIC 



CRITERIA TO CONSIDER IN WRITING AN ACCOUNT OF THE PROCESS 

OF SELF-EVALUATION 

1. TIME: 

How much time dW the process take? 
How was time created? 

2. PRIORITISING: 

How was the issue for evaluation chosen? ^ 
What critBria were relevant in the choice? 

3. EVALUATION PURPOSE: 

What purposes was the process designed to meet? 
e.g. ongoing monitoring, school improvement 

Was the process useful for these purposes? 

4. DEVa.OPMENT OF SKILLS BASE: 

What skills dkl participants acquire? 
Are these transferable: to other issues? 

: to other participants? 

5. PARTICIPANTS: 

How did the team enagage colleagues in the process? 
/ 

- in engendering a belief in the value of the exercise? 

- in sharing the woricload? 
-in any other way? 

6. COST BENEFIT: 

What effect has the attendance at these woricshops had on 
your classes, your colleagues? 

Has the benefit of taking part in the process been worth the 
cost? e.g. Has the ^me been well spent? 

Have the skills acquired been useful? 

7. MANAGEMENT OF TIME: 

Could time have been managed differently to achieve 
purposes more effectively? 

How has the process been kept feasible and manageable? 
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8, RESOURCES: 

What resources cfid we need? 
From where dkj we get these? 

What extra resources will be needed in extending the prccess 
within school and between schools and districts? 

9, DIFFICULTIES: 

What difficulties, if any, arose during the process? 
How were these resolved? 

1 0, In repeating this process within the school/district we 
would: 

a) 



b) . 

c) . 
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